STEIN'S METHOD FOR THE HALF-NORMAL DISTRIBUTION 
WITH APPLICATIONS TO LIMIT THEOREMS RELATED TO 

SIMPLE RANDOM WALK 



CHRISTIAN DOBLER 

Abstract. We develop Stein's method for the half- normal distribution and apply 
it to derive rates of convergence in distributional limit theorems for three statistics 
of symmetric, simple random walk: the maximum value, the number of returns to 
the origin and the number of sign changes up to a given time n. We obtain ex- 
plicit error bounds with the optimal rate for both, the Kolmogorov and the 
Wasserstein metric. In order to apply Stein's method, we compare the characteriz- 
ing operator of the limiting half-normal distribution with suitable characterizations 
of the discrete approximating distributions, exploiting a recent technique by Gold- 
stein and Reinert |GR12| . 



1. Introduction 

This note concerns the rate of convergence issue for three hmit theorems in the 
surroundings of one-dimensional symmetric, simple random walk (SRW). By this we 
mean the discrete time stochastic process {Sn)n>o defined by 5*0 := and Sn '■ = 
^J^^Xj, n > 1, where Xi, X2, ■ ■ ■ , are iid random variables with P{Xi = 1) = 
P{Xi = —1) = 1/2. It has been known for a long time that various statistics 
of the process (S'„)„>o exhibit a quite counter intuitive distributional behaviour, 
see e.g. Chapter 3 of |Fel68) . In |Dobl2a] a rate of convergence for the arcsine 
law was proved using Stein's method for beta distributions (see also |GR12] for an 
improvement of this result with respect to the constant of convergence). Here, we will 
focus on limit theorems which state convergence towards the distribution ofY := \Z\, 
where Z ~ N{0, 1) is standard normally distributed. This distribution is commonly 
known as the half-normal distribution. The technique of proof will be to compare the 
Stein characterization of Y with a suitable characterization for the approximating 
discrete distribution, as was proposed by Goldstein and Reinert [GR12j and also used 
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in |Dobl2a] . Generally, this technique is promising, whenever a concrete formula for 
the probability mass function of the discrete distribution is at hand, which yields a 
Stein characterization similar to the one for the limiting distribution. In the case 
of y = \Z\ the latter is easily found, using the density approach of Stein's method 
(see |CS11] . |EL10] or |CGS11] for instance). Although we could simply quote the 
theory and bounds on the solution to Stein's equation from |CGS11| or |GS11) . for 
instance, we prefer deriving our own bounds, which usually yield better (and mostly, 
in fact, optimal) constants. The rate of convergence results in this paper are always 
with respect to a certain probability metric, which is defined via test functions. Thus, 
if fi and u are two probability measures on (R, B) and is some class of measurable 
test functions that are integrable with respect to fi and z/, then we define the distance 



sup 



hdjjL — I hdu 



For example, if W is the class of Lipschitz continuous functions on M with Lipschitz 
constant not greater than 1 and if /x and v have first moments, then dyy{^, u) is the 
Wasserstein distance of /i and u. On the other hand, if K, is the class of functions 
hz '■= l(-oo,z], € M, then we obtain the Kolmogorov distance 



dKifJ', = sup /x((-oo, z]) - z/((-oo, z]) 



For real- valued random variables X and Y we write d-^lX, Y) for 
d«(£(X),£(F)). 



We begin by introducing the statistics of {Sn)n>o, which convergence in distribution 
to Y. First, consider 



(1) Mn := max Sk e {0,1, . . . ,n} . 

0<k<n 

Then, Mn/y/n — )■ y as n — )■ oo. We will prove the following quantitative version 
of this result. 

Theorem 1.1. Let n = 2m be an even positive integer. Then, with W := Wn '■ = 
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Now, let Kn denote the number of times between 1 and n that the random walk 
returns to the origin, i.e. 

(2) Kn:=\{l <k <n = 2m : Sk = 0}\. 

Then, K^/ y/n — )■ F as n — > oo. Note that intuition might lead us to the (false) 
conclusion that the number of returns to the origin should roughly grow linearly 
with the time n. Here is a theorem which gives error bounds for this distributional 
convergence. 

Theorem 1.2. Let n = 2m be an even positive integer. Then, with W := Wn '■ = 

dMW,Y)<^(^ + 2)+\[^ 
^Jn \TX J n\l -n 

Finally, consider the number C„ of sign changes by the random walk up to time 
n := 2m + 1, m G N, i.e. 



(3) Cn := C2m+i ■.= \{l<k<2m : Su-i ■ Sk+i < 0}| 



Then, 2C2m+i/\/2m + 1 — )■ y as m — )• oo. Again, we obtain a quantitative version 
of this result. 

Theorem 1.3. Let m be a positive integer and n := 2m + 1. 
Then, with W ■.= Wm-= 2^2^+1 / V2m + 1 

^1 2v^ 1 



1 / 2\ f2 1 

Mw;f)<-^(4 + -) + ^-- 



n V ^/7^ 2 / n ^/7^ n'^/'^ 



The rest of the paper is organized as follows. In Section [2] we develop Stein's 
method for the half-normal distribution of Y and review the technique by Goldstein 
and Reinert of comparison with a discrete distribution. In Sections |3l S] and [5] we 
present the proofs of Theorems 11.21 11.11 and 11.31 respectively and in Section [6] we 
show the optimality of the obtained convergence rates. Finally, in Section [7] we give 
proofs of some of the results from Section [2J 
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2. Stein's method for C{Y) and for discrete distributions 

Stein's method is by now a well-established device for proving concrete error 
bounds in distributional convergence problems. Since its introduction by Stein in 
the seminal paper |Ste72) on univariate normal approximation for sums of ran- 
dom variables, satisfying a certain mixing condition, it has undergone a remark- 
able progress. On the one hand, the range of normal approximation problems that 
can be tackled by means of the method has been largely extended, particularly due 
to the development of certain coupling constructions (see |CGS11) for an introduc- 
tion and overview). On the other hand, the essential idea of characterizing a given 
distribution by a certain differential or difference equation, was succesfuUy carried 
over to other prominent distributions, like, for instance, the Poisson distribution 
(see e.g. |Che75] and |BHJ92] ). the Gamma distribution (see |Luk94) ). the expo- 
nential distribution (see e.g. |CFR11] . |PR11] or |FR12| ) or the Beta distribution 
(see |GR 12j and |Dobl2b) ). Furthermore, general techniques have been proposed to 
develop Stein's method for a distribution with a given density, like for example the 
density approach (see |SDHR04] . |CS11] . |EL10] or |CGS11] ) or the general approach 
in |Dobl2b) . which is adapted to a given exchangeable pair. 

We begin by developing Stein's method for the distribtion := C{Y). Note that 
is supported on [0, cxd), since Y = \Z\, where Z ~ A'"(0, 1). We denote by p,F 

the density function and distribution function of Y, respectively. Thus, as a trivial 

computation shows, we have 



where (p, $ denote the density function and distribution function of Z, respectively. 
Further, we denote by ijj the logarithmic derivative of p on [0, oo), thus ^p(x) := = 
—X for all X > 0. According to the density approach in Stein's method, we have the 
following result. 

Proposition 2.1 (Stein characterization for fi). A random variable X with values 
in [0, oo) has the half-normal distribution if and only if 



for all functions f : [0, oo) — )■ M., which are absolutely continuous on every compact 
sub-interval of [0, oo) such that E\f'{Y)\ < oo. 



(4) 
(5) 




F{x) = (2<l>(x) - l)l(o,oo)(x) 
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For a given measurable function h on [0, oo) with E\h(Y)\ < oo Proposition 12.11 
now motivates the following Stein equation 



(6) f{x)-xf{x)=hix)-fiih), 

where we abbreviate ^{h) := E[h{Y)]. This equation is to be solved for the 
function / on [0, oo). If / is a solution to (E]) and W is a given nonnegative random 
variable, then taking expectations, we have the following identity: 



(7) E[hiW)] - E[hiY)] = E [f'iW) - WfiW)] 

As a matter of fact, the right hand side may often be easier bounded (even uni- 
formly in the test functions h coming from some class T-L of functions) than the left 
hand side, if one further tool is available. This additional tool may be a coupling, 
like for example the exchangeable pairs coupling (see |CGS11] ). or a characterization 
for the distribution C{W), as will be exploited in this paper. 

We now introduce the standard solution to (E]). Let : [0, oo) — )■ R be defined 

by 

Mx) -.= -^1 {h{t) - ^i{h))p{t)dt 



p{x) 
1 

!f{x) 











{h{t) - fi{h))if{t)dt 



oo 



(9) {h{t)-^^{h))^{t)dt. 

It is easily checked that fh indeed solves Equation ^ and that the solutions of the 
homogeneous equation corresponding to (|6]) have the form ce^ for some constant 
c G M. This particularly shows that if is bounded, then it is the only bounded 
solution to (|6]) and even the only solution / with lim^._>oo ^"^fi^) = 0. 

Note that ([6]) is the same Stein equation as for the standard normal distribution 
(see e.g. |CGS11] ) except that we only consider funtions on [0, oo), here. Thus, there 
should be some correspondence between the solutions. For given h on [0, oo) consider 
the function (7 on M given by g{x) := /i(|a;|) and denote by fg the standard solution to 
the Stein equation for the standard normal distribution C{Z) and the test function 
g. For X > we obtain from Stein's method for normal approximation (see |CGS11| ) 
that 
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/.(^) = ^/ {g{t) - E[g{Z)])v{t)dt 



1 



— oo 

1 rx 



{h{-t)-E[h{Y)])^{t)dt + —- / [h{t) - E[h{Y)\)^{t)dt 



h[u)ip[u)du + fh{x) 







(10) = h{x) . 

Thus, fg coincides with fh on [0, oo). This allows us to derive properties of the so- 
lutions fh to ([6]) from those of the functions fg, which are well-studied. For example, 
if h is Lipschitz on [0, oo) with Lipschitz constant L > 0, then for x, ?/ G R 

(11) \g{x) - g{y)\ = \h{\x\) - h{\y\)\ < L\\x\ - \y\\ < L\x - y\ . 
So, g is also Lipschitz with the same constant L. 

In order to make good use of identity ([7]) one needs bounds on the solutions fh and 
their (higher) derivatives. Here is what we can achieve in case of the distribution /i. 

Lemma 2.2. Let h : [0, oo) — M fee Borel-measurahle. 

(i) If h is hounded, then fh is Lipschitz and we have with ^0.75 '■= $^^(3/4).- 

(„\ II f, II <- ||fe-M(fe)lloo 
la; llJftlloo ^ 4(^(^0 75) 

(b) ||/;:iloo<2i|/i-M/^)lloo 

(ii) // h is Lipschitz, then fh is continuously differentiahle with a Lipschitz contin- 
uous derivative and we have the hounds: 

(a) II A II 00 < II /i' II 00 

(b) ||/;:i|oo<yf||/^'||oo 

(c) ||/;:iloo<2||/i'|U 

Proof. Assertion (a) of (i) is proved in Section [71 By ffTOl) fh{x) coincides with the 
solution fg{x) to Stein's equation for the standard normal distribution corresponding 
to the test function g{x) = h{\x\). Since \\g\\oo = ||^||ooj E[g{Z)] = E[h{Y)] and, by 
(ITT]) . Ilf^'lloo = 1 1 ^'11 00 bound (b) of (i) and the bounds in (ii) follow from well-known 
bounds in the standard normal case (see |CGS11| but note the factor 1 in bound (a) 
of (ii)). However, in this preprint version a complete proof of Lemma [2.21 is given in 
Section [71 

□ 
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Lipschitz test functions h with Lipschitz constant ||/i'||oo < 1 yield the Wasserstein 
distance. For the Kolmogorov distance the class of functions hz = l(-oo,z]) -2 G K, 
plays this role. Since we only compare distributions with support on [0, oo) we 
may restrict ourselves to the case z > 0. We also denote := fh^- Since the 
functions are uniformly bounded by 1, we immediately get bounds on ||/^||oo and 
||/^||oo from Lemma [2.21 (i). But for this special class of functions, a special analysis 
yields smaller constants. If we denote by the solution to Stein's equation for the 
standard normal distribution with respect to the test function h^, where z G M, we 
obtain from fllOp for 2; > that fz{x) = fz{x) — f-z{x) for each x > 0. Indeed, letting 
gz{x) := hz{\x\), x G R, we have g^ix) = hz{x) - l(_oo = hz{x) - h_z{x) for 
every x 7^ —z, leading to this representation of f^. However, we were only able to 
use this representation and known bounds on the functions to derive part (b) of 
the following lemma. This is why a complete proof is given in Section [71 

Lemma 2.3. For each z > we have: 

(a) ll/.lloo < I 

(b) ll/^lloo < 1 

(c) The function [0, oo) 3 x ^ xfz{x) G M ^■s increasing. 

Remark 2.4. The bound in Lemma [?^ (a) is not optimal. More precisely, computer 
algebra systems suggest that 

supll/^lloo = 0.456296.... 
However, the bound in Lemma [2.31 (b) is optimal. 

In the following, we review the technique of finding a suitable Stein type character- 
ization for a discrete distribution on the integers by Goldstein and Reinert |GR12] . 

A finite integer interval is a set I of the form / = [a, 6] fl Z for some integers a < b. 
Given a probability mass function p : Z — i- M with p{k) > for k & I and p{k) = 
for k E we consider the function ip : I ^ given by the formula 

(12) m := ^ = + 

p{k) p{k) 

where for a function / on the integers Af{k) := f{k + l) — f{k) denotes the forward 
difference operator. The next result, a version of Corollary 2.1 from |GR12| . yields 
various Stein characterizations for the distribution corresponding to p. For such a 
probability mass function p with support a finite integer interval / = [a, b] fl Z, let 
J^{p) denote the class of all real-valued functions f on Z such that /(a — 1) = 0. 

Proposition 2.5. Let Z be a X-valued random variable with probability mass func- 
tion p which is supported on the finite integer interval I = [a, 6] fl Z and is positive 
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there. Let c : [a — 1, 6] fl Z — )■ M be a function with c{k) ^ for all k G /. Then, in 
order that a given random variable X with support I has the same distribution as Z 
it is necessary and sufficient that for all functions g G J^{p) we have 



(13) E c{X - l)Ag{X - 1) + [c{X)^{X) + Ac{X - l)]g{X) 







3. The number, of returns to the origin 

Recall the definition of Kn from ([2]). In this section we give the proof of The- 
orem 11.21 It is known (see e.g. |Fel68] . Problem 9 in Chapter 3) that for each 
r G {0, 1, . . . ,m} 

/ ,N / N ^/^^ X 1 f n — r\ 1 f2m — r 

(14) p{r):=P{K^ = r 



2"-'' \n/2 J 22™-'' \^ m 
Using fll4p as well as the relation 

n + l\ n + 1 fn 



k J n — k + l\k 
we obtain that 

p^r + l)-p{r) _ 2-(2™— i)(2™--i) _ 2-(2— 



?/'(r) 



(15) =2^^-l = ^^ 

2m — r 2m — r 

for all r G {0, 1, . . . , t}. We thus define c(r) := 2m — r for r = —1, 0, . . . , m and 
obtain 

• Ac(r — 1) = c(r) — c(r — 1) = 2m — r — (2m — r + 1) = — 1 

• c{r)ip{r) = — r and 

• 7(r) := c(r)'?/'(r) + Ac(r — 1) = — r — 1 = — (r + 1) . 

Proposition 12. SI thus yields the following characterization of the distribution of i^„. 

Lemma 3.1. A random variable X with support [0,m] fl Z has probability mass 
function p if and only if for every function g G J^{p) 



E[{2m -X + l)Ag{X - 1) - (X + l)g{X)] = 
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Letting g{k) := 1 for A; > and g{k) := for k < we obtain that 



E[Kn] = (2m + l)P{Kn = 0) - 1 

= (2m + 1)2-2" /^2m\ _ ^ ^ 2m2-2" ^^"^ 



m / \ m 



2m /2 ^ 
(16) < =J_7^^ 

A/7rm V 



where the last inequality follows from Stirling's formula. 

Remark 3.2. The bound on E[Kn] in (fT6|) is quite accurate and it is not easy to 
get the precise formula for E[Kn] directly, but one needs some combinatorial tricks. 
Also, since = ET=i ^A,, where Aj := {S2J = 0}, we have E[Kn] = ET=i 2"''f/) 
and this is the partial sum of the diverging series which is used to prove recurrence 
of symmetric, simple random walk. Thus, we see how the Stein characterization in 
Lemma [3.11 gives us information about how fast this series diverges. This indicates, 
that a lot of information might be encoded in such a Stein identity. 

Proof of Theorem Let /i be a Borel- measurable test function and consider the 
corresponding standard solution f '■= fh Stein's equation given by ([H]) and 
We also let fh{x) := for each x < and define g{k) := fh{k/y/n) for /c G Z. 
Writing Ayf{x) := f{x + y) — f{x) we obtain from Lemma [3.11 



E[Wf{W 



(17) 



E[Kng{Kr, 



^E[in -K^ + l)Ag{Ka - 1) - 9{Kn)\ 



e\{^ -W + n-^'^)A^^-^/2f{W - 



E[f{W)\ 



V^E[/\^-./.f{W 



n 



-1/2 



)]+E, 



where 
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1^1 1 



E 

< 11/1 
II/' 



n 



< 



n 



by inequality f|T6l) and because W = n~^/'^Kn- 

Now, using (fT7|) and the fact that / = //^ is a solution to Stein's equation (|6]) we 
obtain 



\E[h{W)]-E[h{Y)]\ = \E[f{W)-Wf{W)]\ 

< \E[f'iW) - v^A„_./,/(Vr - n''/')] I + \E,\ 



E 



w 



(19) 
where. 



l^2| + |^l|, 



(/'(w^)-/'W)rft 



+ 1^1 1 



(20) 



E2 := VnE 



w 



(/'(W^)-/'(t))c^t 



If h is Lipschitz, then we know from Lemma [2.21 (ii) that /' is also Lipschitz with 
Lipschitz constant 2||/i'||oo and we can bound 



w 



E2\<V^\\f"\\ooE / {W-t)dt =V^\\f" 



(21) 



< 



M\f"\ 

\h'\\ 

' t' run 



'-JvK-n-1/2 

II r I 



-1/2 



udu 



'2n 



n 



More generally, if h is measurable and E\h{Y)\ < 00, then, again using that f = fh 
is a solution to Stein's equation ([6]) we conclude 
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E2 = V^E 



W 
W 



{Wf{W) - tf{t) + h{W) - h{t))dt 



(22) =^3 + ^4, 

where 



{Wf{W) -tf{t))dt +y/^E 



w 



W-n-^/^ 



{h{W) -h{t))dt 



Er, 



V^E 



(23) 



E4 := 



w 
w 



{WfiW)-tfit))dt 



{h{W)-h{t))dt 



By the fundamental theorem of calculus we have 



and 









nW r 






E 


■Jw-n-^/^ Jt 



w 



<M\f\\ooE 



w 



{f{s) + sf{s))dsdt 
(W-t)dt\ +v^||/'|U^ 



w 



w 



\s\ds dt 



< V^ll/lloo— + V^||/'||ooi? 



max ?7, 



-1/2 



W) 



w 



W-n-^l'^ Jt 

-t)dt 



ll/lloo , ll/'l 



2^/^ 



2v^ 



max m 



(24) 



ll/'l 



2^ 



In 



2^fn V vr 



where we have used the inequality max(x, y) < x + y valid for x, ?/ > and (fT6|) 
for the last step. 

Note that for Lipschitz h we have |/i(iy) — h{t)\ < \\h'\\oo\W — t\ and hence 



\Ei\ < ^\\h'\UE 



w 



[W -t)dt 



\h'\ 



2v^ 



which together with (1241) yields a worse bound than the one obtained in fl2Tl) . if we 
plug in the bounds on / and /' from Lemma [2l2] (ii). This indicates the optimality of 
the bound (c) in Lemma [2.21 (ii). If h is not Lipschitz, then \E4\ cannot be bounded 
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that easily. Having in mind the Kolmogorov distance, we restrict ourselves to the 
test functions hz = l(-oo,^]) z > 0. Note that for h = we can write 



IE4I = -E4 = VnE 



^{W-n-'^/^<t< 



wy{h{t) - h{W))dt 



and that 

l{VK-n-i/2<j<(4'}(/i(t) — h{W)) = l{W-n-'^/2<t<W}^{W-n''^/2<t<z<W} 
= l{VK-n-i/2<t<2}l{l^-n-i/2<2<H/} 

(25) 

Thus, using ( I25|) we obtain 



— '^{W-n-'^/^<t<W}^{W-n-^/^<z<W} ■ 



= 

< ^/nE 



l{l^-n-V2<t<2}l{vi/-n-i/2<^<VK}^^ 



W 



Idtl 



{W-n-'^/^<z<W} 



(26) 



'iy-n-V2 

P{W - < ^ < yf/j _ p^^^ _ I < < 

P{Kn = 1+[V^Z\) . 



Now note that by unimodality of binomial coefficients for each r = 0, 1, 
can bound 



m we 



< 



(27) 



< 



1 ( 


2m — r 


2m— r \ 


m 


(7r(m 


-r/2)) 


(7r(m 


- (r + 


^V2 





< 



1 I ( 2m-r ) , r even 
2^1(2^) ,rodd 



, r even 



where the next to last inequality comes from 



< 



1 



'Tik 



'2k^ 

. k J-- \k 
by Stirling's formula. 

Note that P{Kn = r) = for r > m = n/2 and, hence, P{Kn = 1 + Lv^-^J) 



unless z < n^/^/2 ~ n Thus, from ( 1271) we have that for each z > 
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f28) 



\Ea\ < 



V2 



'TTTTi \/nn 



Collecting terms we see from ( IT9l) . ( lT8l) . (12T1) and Lemma [Z2] (ii) that for h Lipschitz 

on [0, y/n\ we have 



(29) 



\E[h{W)]- E[h(Y)]\ < 



\h'\ 



1 2 2 



n \ \ n V TT TT 



+ - + 2 



and letting /i = /i^ for z > we see from ([H]), (Jig), ([22]), ^ and Lemma 

Othat 



(30) 



|P(W^ < z) - P(r < z) I < ^ ( ^±£^ + ^ 1 + - 



Theorem 11.21 now follows from f l2^ and f l5U]) . 



□ 



4. The maximum of simple random walk 

Recall the definition of M„ from ([T]), where n = 2m is an even positive integer. In 
this section we give a proof of Theorem II. 1^ which is a little bit more complicated 
than the one of Theorem 11.21 given in the last section. This is so because in this case 
the function ip from (fT2|) vanishes on the odd integers which is inconvenient for our 
method of proof. So we will introduce an auxiliary variable V and use the triangle 
inequality 



(31) dn{W, Y) < dn{W, V) + dn{V, Y) 

to prove the theorem. 
For r = 0, 1, . . . ,n = 2m let p{r) := P{Mn = r). Then, it is known (see [Fel68j . 
Theorem 1 in Section 8 of Chapter 3) that 

(32) p(r) = P(M„ = r) = Pn^r + Pn,r+1 , 

where 
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is the probability that the random walk is in position k at time n. We use the 
convention that (^) = unless x is a nonnegative integer. Hence, if Pn,k 7^ 0, then 
n and k must have the same parity and since we always assume that n is even, we 
have Pn^k = whenever k is odd. From (132|) it easily follows that with ip given by 
(jni) for all r G {0,l,...,n} 



ijj{r) 



Vn,r+2 Pn,r 
Pn,r + Pn,r+1 

Pn,r+2 Pn.,r 



(33) 



Pn,r 







r even 
r odd . 



This is why we introduce the auxiliary random variables 



(34) 



M„ + l 



and V := Vr, 



2Nr,. 



n 



Then, Nn only takes the values 0,1, ... ,m and for s G {0, 1, ... , m} we obtain 
from (132]) that 



q{s) := P{Nn = s) = P{Mn + 1 = 2s) + P(M„ + 1 = 2s + 1) 
= P(M„ = 2s - 1) + P(M„ = 2s) = 2P(M„ = 2s) = 2p(2s) 



(35) 



, 2m , 
2( 12- 

,m + s. 



2m 



Denoting by q the corresponding difference quotient of the probability mass func- 
tion q we obtain for s = 0, 1, . . . , m that 



(36) 



q{s) :-- 



q{s + 1) - q{s) 2p(2s + 2) - 2p(2s) 



g(s) 2p(2s) 

p(2s + 2) -p(2s) ^ (mjT+l) ~ (m+s) 

p(2s) 

/ 2m \ / m-s 

\m+s/ Vm+s+l / 



f 2m\ 
\m+s) 



m — S 



m + s + 1 



/ 2m \ 
Vm+s/ 



\m+s/ 

2s + l 



m+s+1 m+s+1 



m + s + 1 

So, we define the function c : [— l,m] — M by c(s) := m + s + 1. Then, for 



s = 0, 1, . . . , m 
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c{s)g{s) = -2s-l = -{2s + 1) 
Ac(s — 1) = c(s) — c(s — l)=m + s + l — (m + s) 
7(s) := c{s)g{s) + Ac{s - 1) = -2s - 1 + 1 = 
Hence, Proposition 12.51 implies the following lemma. 



1 

-2s. 



Lemma 4.1. A random variable X with values in I := [0,m] fl Z has the probability 
mass function q, if and only if for all functions g G J^{q) 

E [{m + X)Ag{X - 1) - 2Xg{X)\ = . 
Letting g{k) := 1 for k >0 and g{k) := for A; < 0, we see from Lemma [4. II that 



E[Nn\ 



mP(iV„ = 0) _ 2m2-2-(2-) 



m2 



-2m 



2m 

m 



< 



^27r 



E[V] = ±E[N„]<Jl. 



(37) 

The next lemma gives bounds on the distance from V to W. 
Lemma 4.2. For each n = 2m we have 



dwiV, W) < 
dic{V,W) < 



n 

2 1 



Proof. We have 



M„ - 1 M„ + 1 M„ + 1 

= 1 < iVn < 



2 

1 < 2iV„ 



M„ < 1 



(38) 



^ < V - < ^ 



Hence, if h is Lipschitz on [0, ^/n\ with constant 1, then from (138|) follows that 

1 



< Wh'Wr^EW -w\ < 
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which proves the first claim. As to the second claim, note that the Kolmogorov 
distance is scale-invariant which implies that dic{V, W) = dfc{2Nn, Mn) and that for 

z e [0, oo) 



\P{2Nn <Z)- P{Mn <Z)\ = \P{2Nn < [z\) - P{Mn < [z\)\ . 

Hence, we need only consider z G Nq. If -2 = 2A; is even, then 



{2Nn <2k} = { [^^^\ <k} = {Af„ < 2k} 



and, thus, 



(39) P{2Nr, < 2k) = P{Mn < 2k) . 
On the other hand, ii z = 2k + 1, then 

{2Nn <2k + l} = {2Nn < 2k} = {Mn < 2k} C {M„ <2k + l} 

and 

{Mn <2k + l}\ {2Nn <2k+l} = {Mn = 2k + l}. 

Hence, 

\P{2Nn <2k+l)- P{Mn < 2A; + 1) I = P(M„ = 2k + l)= Pn,2k+2 

m + k + ij ~ \m 

(40) < ' ^ 



by Stirling's formula. Thus, for every 2; G M we have the bound 



'2 1 

\P{2Nn <Z)- P{Mn <Z)\< ' 



proving the second claim of the lemma. 

□ 

Having bounded the distance from V to W ^ we may now derive bounds on the 
distance from ^ to y in a similar way as in Section [3l 
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Lemma 4.3. For the distance from V to Y we have 



17 



2 1 

n 



dMV,Y) < ^(2 + -) +2 J- 

A/n V 71/ y TT 

Jn \ \ 71 2/ n 



Proof. Let /i be a Borel-measurable test function and consider the corresponding 
standard solution / := /h to Stein's equation (l6l) given by ([8]) and ([9]). We also 
let fh{x) := for each x < and define g{k) := fh{2k/ y/n) for A; G Z. Writing 
Ayf{x) := f{x + y) — f{x) we obtain from Lemma [4.11 



E[Vf{V)] = —E[N^g{Nn 
\/n 



n 



= —E[{m + Nr,)/\g{N^-l 
(41) = E 

Thus, since / solves Stein's equation ([6]) we obtain from (jH 



^ + ^)A,n-v^f{V-2n-'l') 



E[h{V)\ - E[h{Y)\ = E[nV)-Vf{V)\ 



(42) 
where 



E 



E 



/W-(^ + y)A,„-v./(l^-2n-V^) 



/W-^A,„_././(l/-2n-V2) 



-^1 



(43) 



l^il 



V 



< 



E 

2rr^l 



■\\ruE\v\ < \\f'\ 



2 1 



by inequality fl37j) . Similar to the proof of Theorem 11.21 in Section [3] we have 
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E 



/W-^A,„-v./(F-2n-V2) 



< 



E 



E 



E 



V 



V 



V 



v~ 



{nv)-fit))dt 

{Vf{V)-tf{t) + h{V)-h{t))dt 
{Vf{V)-tf{t))dt 







E 








if 




2 







2 



{h{V) - h{t))dt 



(44) =:\E,\ + \E,\. 
As for ( !2T|) . if h is Lipschitz than by bound (c) from Lemma [2.21 (ii) we easily get 



(45) 



ii?2i < iiriioo^ / {v-t)dt = ^\\f 

2 2 2 n 



2 2\\h'\ 



< 



n 



Similar computations as those in Section [3] yield 



(46) 





1 












1 


< 









' + \\noo[—+E[v]) 

ll/lloo+ll/' 



2 2 

\oo\ + \ - 
'n V TT 



and 



(47) 



\Ea\ < 



\h'\ 



n 



for Lipschitz continuous functions h. With a similar computation as the one leading 
to (l26l) one can show that for h = hz, where z >0, 

(48) \E,\ < p(n^ = [^J+l) < max q{s) . 

\ Z / s=0,...,m 

But from fl35|) we see that 



(49) 



max q(s) = q(0) < —= 

s=0,...,m x/Tim 



2 2 



IT Wn 
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again by Stirling's formula. 

From (H7|) and (H9|) we get that for each z G M 



(50) 



\EA < \ - 



2 2 



TT ^, n 



Collecting terms, we see from f H2|) . f H3|) . (H5|) and Lemma 12.21 (ii) that for h 
Lipschitz on [0, y/n\ we have 



(51) 



E[h{y)\ -E[h{Y)\ 



< \\h'\ 



1 / 2 
2 + - 

n\ TT 



and from (j42]), (iH]), (il]), (iH]), (jSO]) and Lemma Owe see that for each z G M we 
have the bound 



(52) 



P{V <z)- P(Y < z) 



+ 



n 



The claims of the lemma now follow from (ISTj) and ( l52l) . respectively. 



□ 



Proof of Theorem The claims of Theorem 11.11 now follow easily from Lemmas 
14. 2[ 14.31 and from the triangle inequality (13T|) . 

□ 



5. The number of sign changes 

Recall the definition of C2m+i from (|3]). It is known (see Theorem 1 in Section 5 
of Chapter 3 of |Fel68] . for example) that for s = 0, 1, . . . , m 

(0^ _|_ 1 \ 
^ 2-2'"-^ 
m + s + 1/ 

Thus, p is very similar to the probability mass function q of iV„ from Section |4] 
(see (135]) ). This allows for a proof of Theorem ll.3[ which is completely analogous to 
the proof of Lemma 14.31 This is why we will omit some details of the proof. The 
next lemma easily follows from (155]) and Proposition 12.51 

Lemma 5.1. A random variable X with values in I := [0,m] fl Z has the probability 
mass function p, if and only if for all functions g G J^{p) 



E[{m + 1 + X)Ag{X - 1) - 2{X + l)g{X)] = 
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As usual, the lemma implies a bound on the expected value of C2m+i- 



(54) < '^"^ 



Proof of Theorem \1.3\ . Writing n := 2m + 1 we have W = 2Cn/y/n. Let h he & 
Borel-measurable test function and consider the solution / := fh to Stein's equation 
(E]) given by (IHl) and ([9]). Again, we let fh{x) := for each x < and define 
g{k) := fh{2k/y/n) for A; G Z. Writing Ayf{x) := f{x + y) — f{x) we obtain from 
Lemma 15.11 



E[WfiW)] 



^E[2C^giC^)] 
In 



(^ + ^W^)A_^/(l^)-2/(H^) 



A 2 /(IV) 



+ ^1 



+ W)A.f{W)\ - ^E{f{W)\ . 



(55) 
where 



E^ '.= —E 

^ 2 

Using (154|) we obtain 



(56) <i||/'||„+./l||/'||„l + 2 , 

n V vr yjn 

Thus, since / is a solution to Stein's equation 



1 



n 



E{h{W)\-E{h{Y)\ = E[f'iW)-WfiW)] 

El 



(57) 
where 



= E 
< \Ei 



n 



f'{W) - ^A.fiW) 



\E. 



2| ) 
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(5J 



E2 '■= E 



n 



fiW) - ^/\.f{W) 
Z V" 



n 



E 



w 



w — p= 



{nw)-nt))dt 



If h is Lipschitz on [0, \/n\, then by Lemma [2.21 (ii) 



n , 



(59) \E2\<^\\f"\\ooE 



w 

'-JW- 



iw-t)dt =^iiriioo-<^^ 

_2_ } 2 n ^Jn 



If h is Borel-measurable with E\h{Y)\ < 00, then, as before, 



n 



E2 = E 

2 



w 



'-JW- 



{Wf{W)~tf{t))dt 



+ ^E 
2 



w 



w- 



{h{W) ~ h{t))dt 



y/n 



(60) =: E3 + 

Completely analogously to (H6|) one can show that 



(61) 

and as in (H7|) 



< 



2||/'| 



n 

2||f| 



00 ^ i/Xo^^p^] 



+ 



n 



n 

2"||f| 



2 ll/'l 



3/2 



+ 



n 



(62) 



1^4! < 



WW 



n 



for a Lipschitz function h. Now suppose that h = hz = l(-oo,z] for some z > 
Then, as in (HHD and (|49D 



p(0) 



\E,\ < P(a. = [^J+l) < max p{s) 

\ Z / s=0,...,m 

2m + 1 



(63) 



< 



m + 1 
4 



2-2™ <2( ^"^]2-2'" 
m 



< 



Finally, from ( l57j) . fl56l) . ( l59l) and Lemma [2.21 (ii) we see that for each function 
which is Lipschitz on [0, y/n\ 
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(64) 



E[h{W)] -E[h{Y)] 



< \\h'\ 



whereas from ([37]), (EU]), ([M]). 

z eR 



1 / 2\ [2 1 2^2 1 \ 
4 + - + W— + ^ , 

and Lemma 12.31 we have that for each 



(65) 



P(H^ < 2) - P(F < 2) 



1 



^ 1 /2\/2 + 4 ^ ^"l + ^ + 

^ V -y/vr 2 / n a/tt ^^^^^ 



The claim of Theorem 11.31 now follows from f lM|) and ([65 



6. Optimality of the rates 



□ 



In this section we give an argument why the rate rT^I'^ in Theorems ll.mi.3l is 
optimal for both, the Kolmogorov and the Wasserstein distance. Let us explain this 
by means of the example of the number of returns i^„. To see that the rate is optimal 
for the Kolmogorov distance, it suffices to take z = and observe that 



\P{Kn < 0) - P(F < 0)1 = P{Kn = 0) = 2 



-2m 



2m 



1 



2 1 



^ m / Vvrm V tt \in 
by Stirling's formula. Hence, is optimal and the best constant is no less than 

To show that the rate is also optimal with respect to the Wasserstein distance, 
we consider the function h{x) := x which is 1-Lipschitz on R. By (fT6l) we have 



1 



'2rn 



(2m + 1)2 



-2m 



2m 
m 



1 



1 



y/irm 

TT 

- this shows that 



+ 



n 



'vrmx/n 



n y IT n 



1 



Since E[Y] 



yielding the optimality of the rate n In a similar fashion one may prove that 
the convergence rates in Theorems 1 1 . 1 1 and 1 1 . 3 1 are best possible. 
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7. Proofs from Section [2] 

In this section we give proofs of some of the results from Section |2l Most of 
them are quite standard in Stein's method, but in many cases we obtain better 
constants than we would by quoting the general bounds from the literature, for 
example from [CSll]. Recall the density function p and the distribution function F 
of the half-normal distribution from (jl]) and respectively. Also, in this section, 
we let 

d p^ {x\ 

(66) ?/'(x) := — logp(x) = — — = —X , X > 

ax p[x) 

denote the logarithmic derivative of the density function p. Note that ip is a. 
decreasing function. This property will suffice to prove more explicit bounds on the 
solution to Stein's equation in the general density approach than those currently 
given in the literature (see |CGS11] or |CS11| ). We will return to this issue later. 
We will several times make use of the following well-known Mill's ratio inequality, 
which is valid for a; > 0: 

(67) T^M^) < 1 - ^i^) < ^ 

1 + X 

Also, for a Borel-measurable test function h : [0, oo) — )■ M such that E\h{Y)\ < oo 
we let 



h{x) := h{x)-E[h{Y) 
Proof of Lemma \2.^ From ([8]) and ([9]) one immediately gets 

(68) |A(x)| < \\h\\^mm{M{x), N{x)) , 

where 



(69) M(x) := ^ and N{x) := ^ ^^^^ 



p{x) p{x) 



We have 



(70) M'ix) = = _1_ (^(,) _ ^(,)^(,) ) > 

(71) N\x) = ^(p{x) + ij{x){l - F{x))^ < 0, 



24 



CHRISTIAN DOBLER 



since 



rx rx 

p(x)-p(0)= / p\t)dt= I ip{t)p{t)dt 
Jo Jo 

PX 

> ^p{x) / p{t)dt = ^p{x)F{x) 
Jo 

> p{0) + iIj{x)F{x) > il){x)F{x) . 

and, similarly, 

—p{x) — il){x) (l — F{x)) < — lim p{y) < 0. 

J/— 5>00 

Note that we have used that ip is decreasing but no special form of p. Thus 
M is increasing on [0, oo) and is decreasing there. Since A^(0) > = M (0) 
and lim^-^oo M{x) > limj-^oo N{x) = there is a unique point x > such that 
M{x) = N{x) and, clearly, in this point the function min(M, N) attains its maximum 
value. But 

M{x) = N{x) ^ F{x) = 1 - F{x) ^ F{x) = ^ 

and, thus, a; = m is the unique median of F.In our case we have F{x) = 2$(a;) — 1 
and so 

m = $-1(3/4) =: ^0.75. 
Since p{x) = 2{p{x) and F{m) = 1/2 we obtain from (|68|) that 



(72) IIMloo < 



proving the first claim of (i). For the second claim, note that since fh is a solution 
to Stein's equation ([6]) 

(73) \f',ix)\ = \h{x) - ^P{x)Mx)\ < \\h\\^ + II^MU . 

Using (168|) and (167|) we have that 



\Hx)fhix)\ < \\h\\^\ij{x)\mm{M{x),N{x)) < \\h\\ooxN{x) 

(74) =ll^l|oo^^^^^^^<||/^||oo. 



Thus, 
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IIV^Mloo < l|/^||oo 

and fl73p yields the second claim of (i). 

Now, we turn to (ii) and Lipschitz functions h. We will need the following 
identities, which may be derived with the help of Fubini's theorem (see, for ex- 
ample |Dobl2b] for proofs). 



(75) h{x)= F{s)h'{s)ds- {1- F{s))h'{s)ds 

Jo Jx 

"1 /*X /* oo 

(76) /,(x) = -^(-(l-F(x))y F{s)h'{s)ds-F{x) J {l - F{s))h'{s)ds 

I'X fX 

(77) / F{s)ds = xF{x) - / sp{s)ds 
Jo Jo 



(78) 



poo poo 

/ {1-F{s))ds= sp{s)ds- x{l- F{x)) 

J X J X 



To prove (a) note that by fl76|) . fl77j) and (178|) we have 



\h{x)\ < \\h'\U ~ ^^""^^ ^ ^^""^ ~ 

(1 - F{x)) (xF{x) - sp{s)d,s) + F{x) ( /~ sp{s)ds -x{l- F{x)) 
— 

"' oo / \ 

P[X) 

(79) 

^ Fix)E[Y]-f;sp{s)ds 
°^ p{x) 



In our special case of the half- normal distribution we have E[Y] = \/ ^ and 
Jq p{s)ds = 2(p{x) — 2-1 /| and (1791) reduces to 
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^0) 



7r 



Note that Yaa^^ao ^ y^i)^'* = by (167|) so that the bound (IHOj) appears to be optimaL 
This proves (a). Next we prove (b). Since fh is a solution to Stein's equation ([6]) we 
have, using (175|) and ( I76|) 



= [ F{s)h'{s)ds- 
Jo 



+ 



{1- F{s))h'{s)ds 

{l-F{x))j F{s)h\s)ds- F{x) 1^ [l- F{s))h\s)ds^ 
p{x) + (l - F{x))il){x) 



^1) 



F{s)h'{s)ds 



[l- F{s))h\s)d& 



p{x) 

p{x) — F{x)ip{x) 
p{x) 



Thus, using (1701) and ( ITTl) we obtain from ( IHTl) that 
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\fUx)\<\\h'\\ 

+ \\h'\ 



p{x) + (l - F{x))'ip{x) 



p{x) 

p{x) — F{x)ip{x) 



F{s)ds 



p{x) 



POO 

/ {1-F{s))ds 

J X 



,,,„ iP{x) + {l-F{x))ij{x) 
l^ll-l / ^(^)ds 

^ p{x)-FixMx) I 



p{x) 



(82) 



\h'\ 



p{x) 



px poo ' 

G{x) / F{s)ds + H{x) / {1-F{s))ds 

Jo Jx 



where 



(83) 



H{x) := p{x) — F{x)iIj{x) and 

G{x) := p{x) + (l - F{x))iIj{x) = H{x) + tp{x) 



Note that if ip is absolutely continuous, then so are H and G and 



(84) 
(85) 



H'{x) = p{x) — p{x)ip{x) — ip'{x)F{x) = —ip'{x)F{x) 
G'{x) = H\x) + *'(x) = (1 - F{x))%l)'{x) 



In the general case one might use the identities (177|) and ( !78|) to turn (182|) into 
a more explicit expression. However, in our case we make the observation that 
H'{x) = F{x) and G'{x) = -(1 - F{x)) yielding 



(86) H{x) = ^+ F{s)ds and G{x) = {l-F{s))ds, 

since limy^oo G{y) = by (1^7|) . Thus, (152]) may be written as 
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, 2 



G{x)[2G{x) + 2x 



p{x) \ V TT. 

= l^l^ (2if{x) -2x{l- (4<^{x) - 4x(l - <l>(x) + 2x - -y/^) 

^7) =\\h'\\^S{x), 
where, for a; > 0, 

^^(a;) _ _ (^^(a;) + - 1/2) - ^) 



^(a;) := 4- 



V?(x) 



One may now check that the function S attains its maximum value of a/- at x = 0. 

This completes the proof of (b). Finally, we turn to the proof of (c). Differentiating 
Stein's equation and using (175]) as well as fl8ip we obtain 



f^x) = h'{x) - ^'{X)MX) - Hx)fHix) 

■i/j'{x 



{l-F{x)) J F{s)h'{s)ds- F{x) j {1- F{s))h'{s)ds 
F{s)h'{s)ds(^p{x) + (1 - 
(l - F{s))h'{s)ds(p{x) - F{x)^{x) 



h'{x) - 

p[x 

ip{x 
p{x] 



h\x) + F{s)h\s)ds + ^[{^- ns)) h\s)ds 



where 
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U{x) = (l — -F(x)) {ij'ix) — ^{xY^ — ^{x)p{x) and 
(89) V{x) = F{x) {^'{x) - ij{xf) + i){x)p{x) 



In our special case we have 



(90) f/(x) = 2x(/?(x)-2(l-$(x))(l + x2) <0 and 

(91) V{x) = - (2<l>(x) - 1) (1 + x^) - 2xip{x) < 



for each x > 0. The first inequahty follows from (I67|) and the second one is obvious. 
Thus, fromdSSl) we have 
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fH{^)\ < WWoo + ^ F{s)ds[{l - $(a:))(l + x') - x^^x)) 
+ ^ - ^){l + x^)+x^{x)^ 

^I'^'l'- - i) + ^(x) - ^) ((1 - H^)) (1 + 



+ -x{l - - ^)(1 +xv?(x)) 

, + ^Jt^ ( ($(x) - J) + (1 + (l - $(x)) - 



^27r 



i=(xv^(x)-(l + x^)(l-<l>(x))) 



+ (1 + x^)v9(a;) (<l>(x) - ^) - x'^^{x) (l - $(x)) + x(p{xf 
. + (1 - $(x)) + ^{x) - 



i=(xv^(x)-(l + a;2)(l-$(x))) 

, 2||/l'||oo 1 



(92) 

<2||/l'||oo, 



X(f{x) - (1 - <l>(x)) 



once again by (167|) . This completes the proof of (c). 



Proof of Lemma \2.3[ For z, a; > we have the representations 
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^ , , F{xAz)-F{x)F{z) 
fz{x) = 



(93) 
and 

m 

(94) 



p{x) 

^^^W^ ,x<.^ r(l-F(.))M(a;) ,x<z 
^i^^gP^ ,x>z \F{z)N{x) ,x>z 



[1- F{z))M'{x) , x<z 
F{z)N'{x) , x> z 



ii^(p(x)-^(x)F(x)) ,x<z _r(iz£l£lp) 

^(p(x)+^(x)(l-F(x))) ,x>z, "1^^ 



X < z 



, X > z , 



with the functions M, from f l5^ and H, G from (15^ . Since M is increasing and 
is decreasing, we conclude that for each z > 

x>0 P(2) V5(2) 

To show that (7(2;) < ^ for each 2; > 0, we define 

Di{x) := ^(/?(x) - (1 - $(x)) (2$(x) - 1) , X > 

and need to show that Di > 0. We have -Di(O) = > and hma;_>oo -Di(x) = 0. 
Thus, it suffices to show that Di is a decreasing function on [0, 00). We have 

D[{x) = -^x^{x) + (^(x)(2$(a;) - l) - 2^{x){l - $(a;)) 

(96) = ^{x) (-| + 4$(x) - 3) =: ^{x)D2{x) . 

Thus, we want to show that D2{x) < for x > 0. We have D2{0) = —1 and 
hm^_!.oo -02(3^) = — c>o. Furthermore, 



(97) 
(98) 



D',{x) = -^ + Mx) 

D'^{x) = 4:X<^{x) > ,x>0 
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From (p8|) we conclude that D2 is strictly concave. Hence, there is a unique 
Xo G (0, 00) such that 1)2(3^0) = sup^>Q 1^2(2;) and D'2{xq) = 0. By (197|) we have 

^^(xo) = ^ (^(xo) = ^ 

^ -i(log2 + log7r) - ^ = -3 log 2 
2 1 1 1 ^32 

■x^ Xq = 5 log 2 — log TT = log I — 

V TT 



(99) ^ xo = ylog(^— ) = 1.52348... 

Since D2{xq) = —0.01701... < 0, the claim of (a) follows. Next, we prove part (c). 
Note that 



(100) xMx) 
Now, using (17T]) we obtain 



{1 - F{z))xM{x) ,x<z 
F{z)xN{x) ,x > z . 



^ Mi \ M( \^ M'( \ (1-X^)(1-'I'(X)) -X^(X) 

—xN[x) = N{x) + xN [x) = ^ — 

ax Lp{x) 

> 

by fl^7|) . Thus, from fllOOp we see that xfz{x) is increasing on [z, 00). 
Similarly, using (170]) we have 

—xM{x) = M{x) + xM'{x) = ' ^' 

ax 

> 

and xfz{x) is also increasing on [0,z]. This proves (c). To prove (b) note that 
since fz solves Stein's equation Q ioT h = hz 



;i01) fzix) = xfz{x) + l(-oo,.](x) - F{z) . 

Hence, for x < ;z by (jTOD, dlUT]) . (ETj) and (c) it follows that 
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< f:{x) = 2(1 - $(^)) + xMx) < 2(1 - <l>iz)) + zMz) 

z{l-Hz)) 



2(1-<I>(^)) + (2$(z)-l)- 



< 2(1 - $(2)) + (2$(2) - 1) = 1 . 
Similarly, for x > z we have by (171]) . (llOip . (167|) and (c) that 



> f^ix) = xMx) - 2^z) + 1 > zf^iz) - 2^{z) + 1 
= l-2$(^) + (2$(^)-l)^ii^^ 

> 1 - 2$(z) + (2$(^) - 1)^ = -(2<|.(^) - 1)^ 

> 1 -2<l>(^) > -1, 

proving (b). Furthermore, taking x = z and letting z — )■ 00, the proof shows that 
the bound in (b) is optimal. 

□ 
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